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1.  Introduction 

The  main  object  of  this  paper  is  to  prove  a  simple  theorem  of  combinatorial 
nature  and  to  show  its  usefulness  in  the  theory  of  stochastic  processes.  The 
theorem  mentioned  is  as  follows. 

Theorem  1.  Let  <p(u),  0  <  u  <  «,  be  a  nondecreasing  step  function  satisfy¬ 
ing  the  conditions  y?(0)  =  0  and  <p(t  +  u)  =  (pit)  +  (p{u)  for  u  >  0  where  t  is  a 
finite  positive  number.  Define 

JT  if  v  -  <p(v)  >  u  -  <p(u)  for  v  >  u, 

(1)  *(“)  =  to  otherwise. 

Then 

f  \  .  _  ft  -  v(t)  if  0  <  *.(«)  <  t, 

(2)  JoS(u)du  =  ^Q  ,f  v(()>t 

Proof.  If  (pit)  >  t,  then  8(u)  =  0  for  every  u,  and  thus  the  theorem  is 
obviously  true. 

Now  consider  the  case  0  <  (pit)  <  t.  For  u  >  0  define  \f{u)  =  inf  {v  —  <p(v) 
for  v  >  u}.  We  have  \f/(u)  <  u  —  <p{u),  and  \f/(u)  =  u  —  <p(u )  if  and  only  if 
8(u)  =  1  (compare  figures  1,  2,  3). 

It  is  clear  that  \f/(u  +  t)  =  \f/{u)  +  t  —  (p{t)  for  u  >  0  and  that  0  <  \p{v)  — 
\l/( u )  <  v  —  u  for  0  <  u  <  v.  Thus  ^'(w)  exists  for  almost  all  u,  0  <  ^\u)  <  1, 
and 

(3)  fQ  fiu)  du  =  \f/(t)  —  m  =  t  —  (p{t) 

because  \piu)  is  a  monotone  and  absolutely  continuous  function  of  u.  We  also 
note  that  +  0)  =  <piu)  and  <?'(w)  =  0  for  almost  all  u. 

First  we  prove  that 

(4)  ^'(w)  <  5(m)  for  almost  all  u. 

If  \p'iu)  exists  and  if  ^'(w)  =  0,  then  (4)  evidently  holds.  Now  we  shall  prove 
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that  if  yp'iu)  exists,  if  yp'iu)  >  0  and  if  <p(u  +  0)  =  <p(u),  then  8(u)  =  1.  If 
Viu)  >  0,  then  \J/(v )  >  \p(u)  for  v  >  u,  and  therefore  \p(u)  —  infu<s<„  [s  —  <p(s)] 
for  v  >  u.  Thus  u  —  <p{v)  <  \f/{u)  <  u  —  <p(u)  for  v  >  u,  and  consequently, 
u  —  <p(u  -f-  0)  <  i p{u)  <  u  —  <p(u).  If  <p(u  +  0)  =  <p(u),  then  \ p(u)  =  u  —  <p(u) 
which  implies  that  8(u )  =  1.  Since  yp'{u)  <  1  always  holds,  (4)  follows. 


Figure  2 
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Second,  we  prove  that 

(o)  8(u)  <  \p'(u) 


for  almost  all  u. 


If  8(u)  =  0  and  ^'(w)  exists,  then  (5)  evidently  holds.  Xow  we  shall  prove  that 
if  8(u)  =  1,  if  \p'(u)  exists,  if  <p'{u)  =  0,  and  if  u  is  an  accumulation  point  of  the 
set  D  =  {u:  8(u )  =  1,  0  <  u  <  °o),  then  —  1.  Suppose  that  u  E  1)  and 
u  =  lim,,-,*  un  where  un  E  1)  and  un  9^  u.  Then  \J/(u)  =  u  —  and  \[/(un)  = 
un  —  <p(un).  Accordingly,  if  exists  and  if  <p'(u)  =  0,  we  have 


(G)  *'(w)  =  lim  =  1  -  lim  ^ 

n — 'll  Un  ji — >ao  'll  Un 


1  —  <p'(u)  =  1. 


Since  the  isolated  points  of  the  set  D  form  a  countable  set  (possibly  empty), 
(5)  follows. 

If  we  compare  (4)  and  (5),  then  we  obtain  that  ^'(w)  =  8(u )  for  almost  all  u. 
Hence,  by  (3)  we  get  (2)  for  <p(t)  <  t.  This  completes  the  proof  of  the  theorem. 

We  note  that  if  we  alter  the  definition  of  8(u)  such  that  8(u )  =  1  when 
v  —  <p(v)  >  a  —  <p(u)  for  all  v  >  u,  and  8(u)  =  0  otherwise,  then  (2)  remains 
unchanged. 

Furthermore,  if  u  is  a  discontinuity  point  of  (p{u),  then  <p(u)  may  take  any 
value  in  the  interval  [<p(u  —  0),  y>(w  +  0)]. 

By  using  theorem  1,  we  shall  formulate  a  theorem  for  stochastic  processes 
which  will  play  a  fundamental  role  in  our  considerations.  By  this  theorem  we 
shall  find  the  distribution  of  the  supremum  for  certain  types  of  stochastic 
processes.  The  results  obtained  will  be  applied  in  the  theory  of  order  statistics, 
in  the  theory  of  queues,  in  the  theory  of  dams,  and  in  the  theory  of  mathematical 
risk.  We  shall  also  prove  some  results  for  a  random  walk  process. 

Remark  1.  In  a  similar  way  we  can  prove  the  following  discrete  version  of 
theorem  1. 

Theorem  2.  Let  <p(u),  u  =  0,  1,  2,  •  •  •  ,  be  a  nondecreasing  junction  of  u 
satisfying  the  conditions  <p{ 0)  =  0  and  <p(t  +  u)  =  (pit)  +  (p{u)  for  u  —  0,  1,  2,  •  •  • 
where  t  is  a  positive  integer.  Define 

fl  if  v  —  <p{v)  >  u  —  <p(u)  for  v  >  u, 

8(U)  =  1o  otherwise. 


(7) 
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Then 

Proof.  The  case  of  <p{t)  >  t  is  trivial.  Suppose  that  0  <  <p(t)  <  t.  Let 
\f/(u)  =  inf  {v  —  (p(v)  for  v  >  u}  for  u  =  0,  1,  2,  •  •  •  .  Evidently  \f/(u  +  /)  = 
\p(u)  +  t  —  (pit)  and  S(w)  =  \f/(u  +  1)  —  I/{u)  for  u  >  0.  Therefore 

(9)  E  m  =  *(*  +  1)  -  *(1)  =  t  -  (pit), 

u=i 

which  proves  the  statement. 

Among  others,  (8)  yields  an  immediate  proof  for  a  generalization  of  the 
classical  ballot  theorem.  (Cf.  Takacs  [12].) 

If  we  would  deal  with  stochastic  sequences  instead  of  stochastic  processes, 
then  by  using  theorem  2  instead  of  theorem  1  we  could  replace  each  theorem 
proved  for  stochastic  processes  by  an  analogous  theorem  for  stochastic  sequences. 


2.  Stochastic  processes  with  cyclically  interchangeable  increments 

Let  (x(w),  0  <  u  <  t}  be  a  stochastic  process  where  t  is  a  finite  positive 
number.  We  associate  a  stochastic  process  (x*(w),  0  <  u  <  «>}  with  (x(w), 
0  <  u  <  t)  such  that  x*(w)  =  x(w)  for  0  <  u  <  t  and  x*(£  +  u)  =  x*(0  + 
x*(w)  for  u  >  0.  If  the  finite  dimensional  distributions  of  {x*(w  +  u)  —  x*(*0> 
0  <  u  <  t)  are  independent  of  v  for  v  >  0,  then  the  process  {x(w),  0  <  u  <  t} 
is  said  to  have  cyclically  interchangeable  increments . 

First  we  shall  give  a  simple  example  for  such  a  process.  For  0  <  u  <  t,  define 

(10)  x(u)  =  E  Xr 

0  <Tr  <U 

where  tj,  t2,  •  •  •  ,  r»  are  mutually  independent  random  variables  having  a 
uniform  distribution  over  the  interval  (0,  t)  and  xn  X2>  *  •  •  >  Xn  are  cyclically 
interchangeable  random  variables;  that  is,  all  the  n  cyclic  permutations  of 
Xn  X2j  •  *  *  ,  x»  have  a  common  joint  distribution.  If  {xr}  and  {xr}  are  independ¬ 
ent  sequences,  then  (x(w),  0  <  u  <  t}  is  a  stochastic  process  with  cyclically 
interchangeable  increments. 

Now  we  shall  prove  our  fundamental  theorem. 

Theorem  3.  If  (x(r),  0  <  u  <  t}  is  a  separable  stochastic  process  with 
cyclically  interchangeable  increments  and  if  almost  all  sample  functions  are  non¬ 
decreasing  step  functions  which  vanish  at  u  =  0,  then 

(11)  P{x(u)  <  u  for  0  <  u  <  t\x(t)}  = 

lo  if  x(f)  >  f, 

with  probability  1. 

Proof.  Let  x*(w)  =  xiu)  for  0  <  u  <  t  and  x*(^  +  u)  =  x*(0  +  x*(w)  for 
u  >  0.  Define 


(l-^)  if  0  <  x(t)  <  t, 
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(12) 


**/  \  f  1  if  X*(v)  ~  X*(u)  <  v  -  u  for  v  >  u, 

'  '  \0  otherwise. 


Then  8*  (u)  is  a  random  variable  which  has  the  same  distribution  for  all  u  >  0. 
Now  we  have 


(13)  P{x(u)  <  u  for  0  <  u  <  t\x(t)}  =  £{S*(0)|x(0} 


E{S*(u)\x(t)}  du  =  E<-  /  S*(w)  Aijx'f) 


=  i  r 

t  Jo 

=  {(1_sf)  if  °^x(0<i, 


U 


(14) 


i: 


8*(u )  du  = 


.0  if  x(0  >  t, 

with  probability  1,  because  by  (2), 

rt  -  x(0  if  0  <  x(0  <  t, 

10  if  x(0  >  t 

holds  for  almost  all  sample  functions.  This  completes  the  proof  of  the  theorem. 
Finally,  we  note  that  from  (11)  it  follows  that 

(15)  P{x(u)  <  u  for  0  <  u  <  t}  =  E  |[^1  -  ^]+} 

where  [x]+  denotes  the  positive  part  of  x. 


3.  Stochastic  processes  with  interchangeable  increments  and 
stochastic  processes  with  stationary  independent  increments 

A  stochastic  process  (x(w),  0  <  u  <  T}  is  said  to  have  interchangeable 
increments  if  for  all  n  =  2,  3,  •  •  •  and  for  all  t  e  (0,  T] 

(16)  x(jl)-x(^J)’  (r-  1,2,  •••,»). 

are  interchangeable  random  variables;  that  is,  all  the  n\  permutations  of  the 
random  variables  (16)  have  a  common  joint  distribution. 

If,  in  particular,  for  all  n  =  2,  3,  •  •  •  and  for  all  t  G  (0,  T]  the  random  var¬ 
iables  (16)  are  mutually  independent,  identically  distributed  random  variables, 
then  the  stochastic  process  (x(w),  0  <  u  <  T }  is  said  to  have  stationary, 
independent  increments. 

If  P{x(0)  =  0}  =  1,  then  in  both  cases  the  stochastic  process  (x(w),  0  <  u  <  t} 
has  cyclically  interchangeable  increments  for  all  finite  t  G  (0,  T]. 

In  all  subsequent  considerations  we  are  concerned  with  stochastic  processes 
(x(w),  0  <  u  <  T}  having  either  interchangeable  increments  or  stationary, 
independent  increments  and  for  which  almost  all  sample  functions  are  non¬ 
decreasing  step  functions  vanishing  at  u  =  0.  The  parameter  range  [0,  T]  may 
be  either  finite  or  infinite. 
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First  of  all,  I  should  like  to  mention  a  few  basic  properties  of  the  processes 
(x(u),  0  <u<  T} .  Many  theorems  valid  for  stochastic  processes  with  sta¬ 
tionary,  independent  increments  can  be  carried  over  to  stochastic  processes 
with  interchangeable  increments,  because  interchangeability  is  equivalent  to 
conditional  independence  with  common  distribution  (Cf.  M.  Lo&ve  [6],  p.  365 
and  H.  Biihlmann  [2].) 

For  both  types  of  processes, 

(17)  #{x(0}  =  Pl 

if  0  <  t  <  T  where  p  is  a  nonnegative  number  (possibly  p  =  oo).  If  p  =  0,  then 
P{x(t)  =  0}  =  1  for  all  t  G  [0,  T]. 

If  (x(w),  0  <  u  <  oo }  has  stationary  independent  increments  and  p  <  oo, 
then  for  (x(w),  0  <  u  <  <»}  both  the  weak  law  and  strong  law  of  large  numbers 
hold.  Namely  for  any  «  >  0, 


(18) 

and 

(19) 


lim  P 

t — >  50 


=  1 


P 


=  1. 


(Cf.  J.  L.  Doob  [4],  p.  364.) 

If  {x(w),  0  <  u  <  oo}  is  a  separable  stochastic  process,  then  (15)  holds  for  all 
t  >  0.  If  t  —>  oo  in  (15),  then  by  using  (18)  we  obtain 


(20)  P{x(u)  <  u  for  0  <  u  <  oo}  =  p  Pp>\ 


The  left-hand  side  follows  from  the  continuity  theorem  for  probabilities,  and 
the  right-hand  side  from  the  fact  that  [1  —  (x(0/0]+  is  bounded  and  converges 
in  probability  to  [1  —  p]+. 

We  also  mention  that 


(21) 


P{  sup  [x(ti)  —  u]  <  x) 

0  <u  <  » 


1  if  p  <  1, 
0  if  p  >  1. 


For  p  ^  1  this  follows  from  (19),  and  for  p  =  1  by  a  theorem  of  K.  L.  Chung 
and  W.  H.  J.  Fuchs  [3]. 

If  (x(m),  0  <  u  <  oo }  has  nonnegative,  stationary,  independent  increments, 
then  for  9?(s)  >  0, 


(22) 


K{e~  =  c~  u$(*) 


with  an  appropriate  <t>(s)  and  p  =  linv+o  4*(s)/s. 


4.  The  distribution  of  the  supremum  for  stochastic  processes  with 
interchangeable  increments 

In  the  theory  and  applications  of  stochastic  processes  there  frequently  arises 
the  problem  of  finding  the  distribution  of  supo<«<t  £(u)  where  (£(m),  0  <  u  <  T] 


COMBINATORIAL  METHODS 


437 


is  a  separable  stochastic  process.  For  stochastic  processes  with  stationary  in¬ 
dependent  increments  G.  Baxter  and  M.  D.  Donsker  [1]  solved  this  problem 
in  principle.  They  determined  the  double  Laplace-Stieltjes  transform  of 
P{supo<«<t  £(u)  <  x)  for  such  processes.  However,  even  in  simple  cases,  it 
seems  too  complicated  to  invert  the  transforms. 

In  this  section  we  shall  show  that  for  a  wide  class  of  stochastic  processes  the 
distribution  of  supo<u<t£(w)  can  be  found  in  a  simple  way  by  making  use  of 
theorem  3. 

In  this  section  we  suppose  that  (x(r),  0  <  u  <  T }  is  a  separable  stochastic 
process  with  interchangeable  increments  and  that  almost  all  sample  functions 
are  nondecreasing  step  functions  which  vanish  at  u  =  0. 

We  shall  consider  the  following  two  processes  with  interchangeable  increments: 
£x(w)  =  x(u)  —  u  and  &{u)  =  u  —  x(w)  for  0  <  u  <  T,  and  we  shall  find  the 
distribution  of  supo<u<t  £i (u)  and  that  of  supo<M<<  &(m)  for  0  <  t  <  T. 

In  what  follows  we  shall  use  the  notation  dxP{x(u )  <  x}  =  P{x  <  x(u)  < 
x  +  dx]  regardless  of  whether  u  depends  on  x  or  not. 

Theorem  4.  If  {x(m),  0  <  u  <  T}  is  a  separable  stochastic  process  with 
interchangeable  increments  and  if  almost  all  sample  functions  are  nondecreasing 
step  functions  which  vanish  at  u  =  0,  then 

(23)  P{  sup  [x(w)  —  u]  <  x)  =  P{x(t)  <  t  +  x} 

0<w<t 

-  //  (j=f)  W.P{x<y)  <v  +  x,  x(t)  <  2  +  x} 

0  <y  <z  <1 

for  all  x  and  for  all  finite  t  £  (0,  T], 

Proof.  We  shall  prove  that  the  subtrahend  on  the  right-hand  side  of  (23) 
is  the  probability  that  x(0  ^  t  +  x  and  xW  >  u  +  x  for  some  u  £  [0,  t] 
(compare  figure  4).  Suppose  that  x(0  =  z  x  where  0  <  z  <  t  and  that  the 
last  passage  of  x(w)  through  u  +  x  occurs  at  u  =  y.  Then  xiy)  =  V  +  x  and 
x(w)  —  x(y)  <  u  —  y  for  y  <  u  <  t.  Given  that  x(y)  =  y  +  x  and  x(0  =z  +  x, 
by  theorem  3,  the  event  (x(w)  —  x(y)  <  u  —  y  for  y  <  u  <  t}  has  probability 
(t  —  z)/(t  —  y)  if  0  <  y  <  z  <  t.  If  we  integrate  (t  -  z)/(t  —  y)  with  respect 
to  P{y  +  x  <  x(y)  <y  +  x  +  dy,z  +  x<  x(0  <  2  +  x  +  dz}  over  the  do¬ 
main  0  <  y  <  z  <  t,  then  we  get  the  subtrahend  on  the  right-hand  side  of  (23). 
If,  in  particular,  x  =  0  in  (23),  then  by  (15), 

(24)  P{  sup  [x(t0  —  u]  <  0}  =  f  (1—7)  dyP{x{t)  <  y}- 

o<u<t  Jo  \ 

Theorem  5.  If  {x(u),0  <  u  <  T}  is  a  separable  stochastic  process  with 
interchangeable  increments  and  if  almost  all  sample  functions  are  nondecreasing 
step  functions  which  vanish  at  u  =  0,  then 

(25)  P{  sup  [u  —  x(w)]  <  x}  =  1  —  f  fduP{x(y)  <y  -  x) 

0  <u<t  Jx  y 

for  0  <  x  <  t  <  T, 
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Proof.  We  shall  prove  that  the  subtrahend  on  the  right-hand  side  of  (25) 
is  the  probability  that  x(w)  <  u  —  x  for  some  u  e  (0,  t]  (compare  figure  5). 
Suppose  that  the  first  passage  of  x(«)  through  u  —  x  occurs  at  u  =  y  where 
x  <  y  <  t.  Then  x(y)  —  y  —  x  and  x(w)  >  u  —  x  for  0  <  u  <  y,  or  equiv¬ 
alently,  x(y)  —  x(w)  <  y  —  u  for  0  <  u  <  y.  Given  that  x(y)  =  y  —  x,  by 
theorem  3,  the  event  (x(y)  —  x(w)  <  y  —  w  for  0  <  w  <  y)  has  probability 
x/y  for  0  <  x  <  y.  If  we  integrate  x/y  with  respect  to  P{y  —  x  <  x(y)  < 
y  —  x  +  dy}  from  x  to  t,  then  we  get  the  subtrahend  on  the  right-hand  side 
of  (25). 

Example  1.  Theory  of  order  statistics  (cf.  L.  Tak&cs  [15]  and  [16]).  Let 
|2,  •  •  •  ,  £n  be  mutually  independent  random  variables  having  a  common 
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continuous  distribution  function  F(u).  Denote  by  Fn(u )  the  empirical  distribu¬ 
tion  function  of  the  sample  (&,  £2,  •  •  •  ,  £„)•  For  0  <  a  <  (3  <  1,  define 

(26)  5*  («>  j8)  =  sup  [Fn(u)  —  F(u)]. 

a  <F(w)  <(3 

It  can  easily  be  seen  that  (a,  j8)  is  a  distribution-free  statistic.  To  find  the 
distribution  of  8„(a,  (3)  we  may  suppose  that  F{u )  =  u  for  0  <  u  <  1.  Then 
Fn(u )  =  x(w)  for  0  <  u  <  1  where  the  process  (x(w),  0  <  u  <  1}  is  defined  as 
follows.  We  choose  n  points  independently  in  the  interval  (0,  1)  such  that  each 
point  has  a  uniform  distribution  over  (0,  1).  Denote  by  x(w)  the  ratio  of  the 
number  of  points  in  the  interval  (0,  u]  to  n.  Then  the  process  (x(w),  0  <  u  <  1} 
has  interchangeable  increments  and  satisfies  the  assumptions  of  theorem  4.  Now 
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P{S^(o:,  0)  <  x]  =  P{  sup  [x(m)  —  It]  <  X } 

a  <u  <0 

and  by  a  slight  modification  of  (23)  we  get 

(28)  P{  sup  [x(w)  -  u]  <  x]  =  P{xi0)  <  0  +  x) 

a  <u  <0 

~  SI  (i — pixiy)  =  y  +  x,  x{0)  =  z  +  a-} 
a<v<z<p  \0  —  y/ 

for  all  x.  In  (28)  P{xiy)  =  y  +  x,  xi0)  =  z  +  a-}  =  0,  except  if  y  =  (j  —  nx)/n 
and  z  =  (k  —  nx)/n  where  0  <  j  <  k  <  n.  Thus  for  a:  >  0, 

(29)  P{Si(a,P)  <  x]  =  E  P-fxW  =  Z 


EE 


k  <n(Ji+x) 

[nix  +  0)  -  fc"|  „  f  ( j  -  nx\  j  ^  1c] 
IW+  a)  -  J  p  1*  \~ir) =  n  xW  =  nj 


n(x-j-a)  <j  <k  <n(x-\-(3)  **) 


nj 


and  here 
(30) 


P{x(u)  =  n}  =  (")U’(1  ~u)’~‘ 


for  0  <  j  <  n  and  0  <  u  <  1,  and 


n 


(3D  r{x(u)  =  ixM  =  l}=Kk_mn_k) 

for  0  <  j  <  k  <  n  and  0  <  u  <  v  <  1. 


— ~7\  t  U’iv  —  w)i_,’(l  —  v)"-* 


5.  The  distribution  of  the  supremum  for  stochastic  processes  with  stationary 
independent  increments 

If  (x(w),  0  <  u  <  T)  has  stationary  independent  increments,  then  (23) 
becomes 

(32)  P{  sup  [x(m)  -  u]  <  x}  =  P{x(0  <  t  +  x) 

0  <u<t 

~  JJ  (jzrf)  dypix(y)  <y  +  x}dzP{x{t  -  y)  <z  -  y)-t 

0  <y  <z  <t 

which  is  valid  for  all  x  and  for  all  finite  t  e  (0,  T].  For,  in  this  case,  %iy)  and 
x(0  ~  x(y)  are  independent  variables  and  x(0  —  xiy)  has  the  same  distribution 
as  x(t  ~  y)-  If  we  introduce  the  notation 

(33)  W  {t,  x)  =  P{  sup  [x(w)  —  u]  <  x] 

0  <u<t 

and  Wix )  =  TF(°° ,  x),  then  by  (24)  we  can  write  down  (32)  in  the  following 
form : 

(34)  W(t,  x)  =  P{x(t)  <t  +  x}  -  f‘  »'(<  -  V,  0  )dyP{x{y)  <y  +  x}. 

If  T  =  oo  and  t  —  ° c ,  then  (32)  or  (34)  cannot  be  used  to  find  Wix)  = 
P{ supo<u<«  [x(w)  —  w]  <  a-}  ;  however,  the  following  theorem  is  applicable. 
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Theorem  G.  If  (x(w),  0  <  u  <  *>)■  is  a  separable  stochastic  process  with 
stationary  independent  increments,  if  almost  all  sample  functions  are  nondecreasing 
step  functions  which  vanish  at  u  —  0,  and  if  E{x(u)}  =  pu,  then  for  every  x, 

(35)  P{  sup  [x(w)  -  u]  <  a-}  =  1  —  (1  —  p)  [  *  dyP{x(y)  <  y  + 

whenever  0<p<l.//p>l,  then  the  left-hand  side  of  (35)  is  0. 

Proof.  By  the  continuity  theorem  for  probabilities  we  have 

lP(.r)  =  lim  W(t,  x). 

First,  let  0  <  p  <  1.  Then,  by  (20),  we  find  that  IF(0)  =  lim*_*»  1F(/,  0)  = 

1  —  p.  If  we  let  t  — >  in  (34),  then  we  get  (35).  It  follows  from  (21)  that 
IF(gc)  =  1,  that  is,  IF (a;)  is  a  proper  distribution  function.  Evidently,  W(x)  =0 
if  x  <  0.  If  p  >  1,  then  IF(x)  =  0  for  every  x,  which  follows  from  (21).  If 
(x(w),  0  <  u  <  T]  has  stationary  independent  increments,  then  theorem  5  is 
applicable  for  every  t  (finite  or  infinite),  and  thus,  in  the  case  of  T  =  <x>, 

(36)  P{  sup  [u  -  x(w)]  <  x}  =  1  -  j  f  dvP{x(y )  <  y  —  x} 

o<u<«>  jx  y 

for  x  >  0. 

Remark  2.  If  {x(*0,  0  <  u  <  =c}  has  stationary  independent  increments 
and  $($)  is  given  by  (22),  then  we  can  prove  easily  that  the  distributions  (35) 
and  (36)  can  also  be  obtained  in  the  following  way. 

If  0  <  p  <  1,  then  for  the  distribution  function  IF(z)  defined  by  (35)  we  have 

(37)  j\-„  dW(l)  = 

s 

whenever  9t(s)  >  0. 

Further,  for  x  >  0  we  have 

(38)  P{  sup  [u  —  x(w)]  <  a-}  =  1  —  e~~ux 

0<M<» 

where  w  is  the  largest  real  root  of  the  equation  <f>(w)  =  <*>.  If  0  <  p  <  1,  then 
w  =  0,  and  if  p  >  1,  then  w  >  0.  (Cf.  L.  Takacs  [17].) 

Example  2.  Theory  of  queues  (cf.  L.  Takacs  [9],  [11],  and  [13]).  Suppose 
that  in  the  time  interval  (0,  °o)  customers  arrive  at  a  counter  in  accordance 
with  a  random  process.  The  customers  are  served  by  a  single  server  in  the 
order  of  arrival.  The  server  is  idle  if  and  only  if  there  is  no  customer  in  the 
system.  Denote  by  x(w)  the  total  service  time  of  all  those  customers  who  arrive 
in  the  interval  (0,  u].  We  suppose  that  (x(w),  0<w<°o}isa  separate  stochastic 
process  with  nonnegative,  stationary,  independent  increments  and  that  almost 
all  sample  functions  are  nondecreasing  step  functions  vanishing  at  u  =  0.  Denote 
by  7j(f)  the  virtual  waiting  time  at  time  t,  that  is,  the  time  that  a  customer 
would  have  to  wait  if  he  arrived  at  time  t.  Let  a(t )  denote  the  total  idle  time 
of  the  server  in  the  interval  (0,  t).  If  ?j(0)  =  0,  then  it  can  easily  be  seen  that 
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(39)  P{i)(t)  <  x]  =  P{  sup  [x(tt)  —  u]  <  x } 

0  <u<t 

and 

(40)  P{ait)  <  a:}  =  P{  sup  [ u  —  x(w)]  <  %}• 

o  <«<« 

If,  in  particular,  customers  arrive  at  the  counter  in  accordance  with  a  Poisson 
process  of  density  X  and  the  service  times  are  mutually  independent,  identically 
distributed  random  variables  with  distribution  function  H(x )  and  independent 
of  the  arrival  times,  then  (x(w),  0  <  u  <  <»}  has  nonnegative  stationary 
independent  increments  and 

(41)  P{x(u )  <  x]  =  t  Hn(x) 

n  =  0  nl 

where  Hn(x)  denotes  the  n-th  iterated  convolution  of  H(x)  with  itself;  H0(x )  =  1 
if  x  >  0  and  H0(x)  —  0  if  x  <  0.  If  a  denotes  the  average  service  time  and  \f/(s), 
the  Laplace-Stieltjes  transform  of  H(x),  then  p  =  \a  and  4>(s)  =  X[1  —  ^(s)]. 

In  this  case  the  distributions  and  the  limiting  distributions  of  r](t )  and  a(t ) 
are  given  by  (32),  (35),  (25),  (36),  (37),  and  (38). 

Example  3.  Theory  of  dams  (cf.  D.  G.  Kendall  [5],  P.  A.  P.  Moran  [7], 
and  L.  Takacs  [14]).  Consider  a  dam  (reservoir)  with  infinite  capacity  and 
suppose  that  water  is  flowing  into  the  dam  in  accordance  with  a  random  process. 
Denote  by  x(u)  the  total  quantity  of  water  flowing  into  the  dam  in  the  interval 
(0,  u].  Suppose  that  (x(w),  0  <  u  <  <»}  is  a  separable  stochastic  process  with 
stationary  independent  increments  and  that  almost  all  sample  functions  are 
nondecreasing  step  functions  which  vanish  at  u  =  0.  Suppose  that  the  release 
is  continuous  at  a  constant  unit  rate  when  the  dam  is  not  empty.  Denote  by 
r](t)  the  content  of  the  dam  at  time  t,  and  by  a(t )  the  total  time  in  the  interval 
(0,  t)  during  which  the  dam  is  empty.  If  rj( 0)  =  0,  then  the  distributions  of  y{t) 
and  a{t)  are  given  by  (39)  and  (40)  respectively. 

Now  I  should  like  to  mention  two  examples  for  input  processes  of  this  type. 

(i)  For  x  >  0, 

(42)  P{x(u)  <x}=  Jq  e~vyu~l  dy 

where  p  is  a  positive  constant.  Then  p  —  1/p  and  4>(s)  =  log  (1  +  (s/p)). 

(ii)  For  x  >  0, 

1  f  x/u 2 

(43)  P{x(u)  <  x }  =  — r=  /  e-i/4i/y-3/2  dy. 

Then  p  =  <x>  and  4>(s)  =  $1/2. 

Example  4.  Theory  of  mathematical  risk  (cf.  C.  O.  Segerdahl  [8]).  Suppose 
that  a  company  deals  with  insurance  and  in  the  time  interval  (0,  u ]  receives 
the  gross  risk  premium  u,  and  the  total  claim  in  the  time  interval  (0,  u ]  is  x(^) 
where  (x(w),  0  <  u  <  is  a  separable  stochastic  process  with  stationary, 
independent  increments  almost  all  of  whose  sample  functions  are  non¬ 
decreasing  step  functions  which  vanish  at  u  =  0.  Denote  by  y(u)  the  risk 
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reserve  at  time  u.  If  7(0)  =  x ,  then  y(u)  =  x  +  u  —  x(u)-  For  x  >  0,  denote 
by  8X  the  time  when  y(u)  becomes  0  for  the  first  time,  that  is,  8X  is  the  time 
when  the  risk  reserve  becomes  depleted.  The  distribution  of  6X  is  determined  by 

(44)  P{8X>  t]  =  P{  sup  [x(w)  -  u]  <  x}, 

0  <u  << 

and  the  right-hand  side  of  (44)  is  given  by  (32).  If  E{x(u)}  =  pu  and  p  >  1, 
then  8X  is  finite  with  probability  1,  whereas  if  0  <  p  <  1,  then  there  is  a  positive 
probability  that  8X  =  °o;  that  is,  that  the  risk  reserve  will  never  be  depleted. 

If  the  insurance  company  deals  with  whole-life  annuities,  then  the  risk 
reserve  can  be  expressed  as  7(m)  =  x  +  x(w)  —  u  where  x  is  the  risk  reserve 
at  time  u  =  0  and  the  process  (x(w),  0  <  u  <  <»}  has  similar  properties  to  the 
above  one.  Now  if  8X  denotes  the  time  when  y(u)  becomes  0  for  the  first  time, 
then  for  0  <  x  <  t  we  have 

(45)  P{8X  >  t)  =  P{  sup  [w  —  x(^)]  <  x}, 

0  <u  <t 

and  the  right-hand  side  of  (45)  is  given  by  (25),  or  also  by  (38),  for  t  =  ° 0. 

6.  A  random  walk  process 

This  section  is  independent  of  the  preceding  ones  and  illustrates  that  often 
very  simple  combinatorial  arguments  yield  useful  results  in  the  theory  of 
stochastic  processes. 

Suppose  that  a  particle  performs  a  random  walk  on  the  z-axis.  Starting  at 
x  —  0  in  each  step  the  particle  moves  a  unit  distance  to  the  right  or  a  unit 
distance  to  the  left  with  probabilities  p  and  q  respectively  (p  +  q  =  1, 
0  <  p  <  1).  Suppose  that  the  successive  displacements  are  independent  of  each 
other.  Denote  by  t)n  the  position  of  the  particle  after  the  n-th  step;  170  =  0. 
We  have 

(46)  P{Vn  =  X)  =  L n±x  \  p  2  q  2 
for  x  =  n,  n  —  2,  •  •  •  ,  —  n  +  2,  —n. 

If  we  suppose  that  the  displacements  of  the  particle  occur  at  random  times 
in  the  time  interval  (0,  00),  and  v{u)  denotes  the  number  of  steps  taken  in  the 
time  interval  (0,  u],  then  x{u)  =  y\V(V)  is  the  position  of  the  particle  at  time  u. 

We  are  interested  in  the  investigation  of  the  stochastic  process  (x(^), 
0  <  u  <  00}  in  the  case  when  {?7„}  and  {y(w)}  are  independent  and  with  prob¬ 
ability  1,  v(u),  0  <  u  <  00,  increases  only  in  jumps  of  magnitude  1. 

In  the  particular  case  when  {v(u),  0  <  u  <  is  a  Poisson  process  of  con¬ 
stant  density  and  p  =  q  —  \  by  using  analytical  methods,  G.  Baxter  and  M.  D. 
Donsker  [1]  found  that 

(47)  P{  sup  x(u)  <  a]  =  1  -  /  ^P{x(u)  =  a }  du 

0<u<t  JO  u 

whenever  a  is  a  positive  integer. 
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In  this  section  we  shall  find  in  an  elementary  way  the  distribution  of 
supo<«<<  x(w)  and  the  joint  distribution  of  supo<w<t  x(w)  and  info<M<*  x(w)  for 
the  general  process. 

The  following  theorem  is  a  generalization  of  (47)  for  an  arbitrary  process 
{ v(u ),  0  <  u  <  »}. 

Theorem  7.  If  p  =  q  =  \  and  a  is  a  positive  integer,  then 

(48)  P{  sup  x(w)  <  a}  =  P{—a  <  x(f)  <  a}- 

0<u<t 

Proof.  First, 

(49)  P{  sup  x(w)  >  a  and  x(0  >  a]  =  P{x(f)  >  a } 

o  <u<t 

evidently  holds.  Second,  we  have 

(50)  P{  sup  x(w)  >  a  and  x(0  <  a]  =  P{  sup  x(u)  >  a  and  x(0  >  «} 

0<u<t  0<u<t 

=  P{x(t )  >  a}. 

In  proving  (50)  let  r  be  the  first  value  of  u  for  which  x(u)  =  a-  If  we  reflect 
the  sample  curve  for  u  >  r  in  the  line  x  =  a,  then  we  shall  not  change  the 
probabilities  because  the  changes  in  x(u)  after  r  are  equally  likely  to  be  positive 
or  negative  and  are  independent  of  the  changes  before  r.  This  implies  (50).  If 
we  add  (49)  and  (50),  we  get  P{  supo <u <t  x(u)  >  a],  whence  (48)  follows. 

The  following  theorem  generalizes  (48)  further  for  arbitrary  p. 

Theorem  8.  If  a  is  a  positive  integer,  then 

(51)  P{  sup  x(u)  <  a}  =  P{x(t)  <  a]  -  (^)  P{x(0  <  -a). 

o  <u<t  \q/ 

Proof.  First  we  shall  prove  that  for  x  <  a, 

(52)  P{i 7r  <  a  for  r  =  0,  1,  •  •  •  ,  n  and  r?„  =  x} 

=  Plvn  =  x}  -  (2)‘  P{vn  =  x -2a} 

where  the  distribution  of  rj„  is  given  by  (46). 

Formula  (52)  can  be  proved  as  follows.  If  p  =  q,  then  {r?„,  n  =  0,  1,  2,  •  •  •} 
describes  the  path  of  a  symmetric  random  walk.  By  applying  the  reflection 
principle,  we  get 

(53)  P{rir  <  a  for  r  =  0,  1,  •  •  •  ,  n  and  r?„  =  a:} 

=  P  {rjn  =  x}  —  P{rin  =  x  —  2a) 

where  now  the  probabilities  on  the  right-hand  side  are  given  by  (46)  with 
P  —  q  —  h'  In  the  symmetric  random  walk  each  favorable  path  {770,  m,  •  •  •  >  in} 
has  probability  1/2",  and  in  the  general  case,  each  such  path  has  probability 
pl(n+x)qHn-x )#  Accordingly,  if  we  multiply  (53)  by  2 npl(n+*)gl(»-*)  and  use  the 
general  notation  (46),  we  get  (52). 

Summing  (52)  over  x  <  a,  we  obtain 
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(54) 


P{r]T  <  a  for  r  =  0,  1,  •  •  •  ,  n)  =  P{rjn  <  a) 


< 


-a}. 


If  we  multiply  (54)  by  P{v(t)  =  and  add  for  n  =  0,  1,  2,  •  •  •  ,  then  we  get 
(51)  which  was  to  be  proved. 

Remark  3.  In  the  particular  case  where  (v(w),  0  <  u  <  <»}  is  a  Poisson 
process  of  density  X,  we  have 

/pV/2 

(55)  P{x(u)  =  k]  =  e~Xu  Ik(2\p1/2qll2u) 


for  k  =  0,  ±1,  ±2,  •  •  •  ,  where  h(x)  is  the  modified  Bessel  function  of  order  k 
defined  by 


(56) 


h(x)  = 


^  (z/2)2'+* 
it-ojltf  +  ft)! 


for  k  >  0  and  I-k(x )  =  h(x). 

If  -{V(w),  0<w<°o}isa  Poisson  process  of  density  X  and  we  use  h-i{u)  — 
Ik+i(u)  —  2 klk(u)/u,  then  we  can  prove  easily  that  (51)  can  be  written  in  the 
form  (47). 

Finally  we  shall  find  the  joint  distribution  of  supo<u<<  x(w)  and  info<M<t  x(w). 
Theorem  9.  If  a  and  b  are  positive  integers ,  then 


(57)  P{—b  <  x(w)  <  a  for  0  <  u  <  t} 

—  (a-f  b)k 


=  £  (2) 
i--.  \q/ 

-  i  (2) 

\qj 


P{2(a  +  b)k  —  b  <  x(0  <  2 (a  +  b)k  +  a} 


(a  +  b)k  +  a 


P{—2(a  +  b)(k  +  1)  +  b  <  X(0  <  -2 (a  +  h)k  -  a}. 


Proof.  In  the  particular  case  where  p  =  q  we  have  for  — b  <  x  <  a , 
(58)  P{—b  <  n]r  <  a  for  r  =  0,  1,  •  •  •  ,  n  and  rjn  =  a-} 


=  £  [P{vn  =  x  +  2(a  +  b)k}  —  P {tin  =  x  —  2(a  -f  b)k  —  2a}] 

fc=  -« 

where  the  distribution  of  t]n  is  given  by  (46)  with  p  =  q  —  h-  This  follows  from 
the  theory  of  random  walks.  (Cf.,  for  example,  L.  Takacs  [10],  theorem  5.)  In 
the  particular  case  where  p  =  q  =  each  favorable  path  {no,  n i,  •  •  •  ,  Vn]  has 
probability  1/2",  and  in  the  general  case  each  such  path  has  probability 
pUn+x)qi(n-x )'  Accordingly,  if  we  multiply  (58)  by  2npi(n+a:)gi(n-x),  and  if  we  use 
the  general  notation  (46),  then  we  obtain  in  the  general  case 

(59)  P{— b  <  rjr  <  a  for  r  =  0,  1,  •  •  •  ,  n  and  t?„  =  x) 

°°  /tjX—  (a+6)A 

=  E  (-)  PiVn  =  x  +  2(a  +  b)k} 

-  t_E  (|)  P{v,  =  X  -  2 (a  +  b)k  -  2a}. 
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Hence, 

(60)  P{  —  b  <  r\r  <  a  for  r  =  0,  1,  •  •  •  ,  n] 

“  /r)\-  (a+b)k 

=  L  (-)  P{2(a  +  b)k  -  b  <  Vn  <  2(a  +  b)k  +  a} 

fc=-oe  \q ) 

-  L  (-)  P{-2(a  +  6)(/c  +  1)  +  b  <  Vn  <  —  2(a  +  6)fc  -  a). 

If  we  multiply  (60)  by  P{v(t)  =  n)  and  add  for  n  —  0,  1,  2,  •  •  •  ,  then  we  get 
(57)  which  was  to  be  proved. 

Remark  4.  In  the  particular  case  where  p  =  q  =  (57)  reduces  to 

(61)  P{—b  <  x(w)  <  a  for  0  <  u  <  f} 


=  t  (-1  )kP{(a  +  b)k-b  <  X(t)  <  (a  +  b)k  +  a). 

—  oo 


We  also  note  that  if  instead  of  (58)  we  use  the  following  equivalent  formula 
(cf.  L.  Takacs  [10],  theorem  5), 


(62)  P{— b  <  T)r  <  a  for  r  =  0,  1, 

2 

(a  +  b) 

then  (61)  can  also  be  written  in  the  following  form: 

(63)  P{—b  <  x(u)  <  a  for  0  <  u  <  /} 


,  n  and  rjn  =  x} 

a  +  b  (  k,TV  Y  .  , 

JL  I  COS : — r  )  Sill  - 

k=o  \  a  +  b  a 


kva  .  kit  (a  —  x ) 
sin 


+  b 


a  +  b 


(a  + 


hi  £  [i-(-im(cos^) 


Sill 


cos 


kir 


kira 

^Tb  w"  a  +  6 


Sill 


kir 


a  +  b 


where  Gt(z )  =  E{zv^}  is  the  generating  function  of  the  random  variable  v{t). 
If  {v(u),  0<w<°o)  is  a  Poisson  process  of  density  X,  then  Gt{z )  =  e~u{l~z). 
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